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In recent years experiments have demonstrated that living cells can measure low chemical con¬ 
centrations with high precision, and much progress has been made in understanding what sets the 
fundamental limit to the precision of chemical sensing. Chemical concentration measurements start 
with the binding of ligand molecules to receptor proteins, which is an inherently noisy process, es¬ 
pecially at low concentrations. The signaling networks that transmit the information on the ligand 
concentration from the receptors into the cell have to filter this noise extrinsic to the cell as much 
as possible. These networks, however, are also stochastic in nature, which means that they will also 
add noise to the transmitted signal. In this review, we will first discuss how the diffusive transport 
and binding of ligand to the receptor sets the receptor correlation time, and then how downstream 
signaling pathways integrate the noise in the receptor state; we will discuss how the number of re¬ 
ceptors, the receptor correlation time, and the effective integration time together set a fundamental 
limit on the precision of sensing. We then discuss how cells can remove the receptor noise while 
simultaneously suppressing the intrinsic noise in the signaling network. We describe why this mech¬ 
anism of time integration requires three classes of resources—receptors and their integration time, 
readout molecules, energy—and how each resource class sets a fundamental sensing limit. We also 
briefly discuss the scheme of maximum-likelihood estimation, the role of receptor cooperativity, and 
how cellular copy protocols differ from canonical copy protocols typically considered in the compu¬ 
tational literature, explaining why cellular sensing systems can never reach the Landauer limit on 
the optimal trade-off between accuracy and energetic cost. 

PACS numbers: 87.16.Xa 87.10.Vg 05.70.-a 87.18.Tt 


I. INTRODUCTION 

Living cells can sense changes in their environment 
with extraordinary precision. Receptors in our visual sys¬ 
tem can detect single photons [T] , some animals can smell 
single molecules [5], swimming bacteria can respond to 
the binding and unbinding of only a limited number of 
molecules Ell], and eukaryotic cells can respond to a 
difference in ^ 10 molecules between the front and the 
back of the cell [5]. Recent experiments suggest that the 
precision of the embryonic development of the fruitfly 
Drosophila is close to the limit set by the available num¬ 
ber of regulatory proteins W- This raises the question 
what is the fundamental limit to the precision of chemical 
concentration measurements. 

Living cells measure chemical concentrations via re¬ 
ceptor proteins, which can either be at the cell surface 
or inside the cell. These measurements are inevitably 
corrupted by two sources of noise. One is the stochastic 
transport of the ligand molecules to the receptor via dif¬ 
fusion; the other is the binding of the ligand molecules 
to the receptor after they have arrived at its surface. 
Berg and Purcell pointed out in the seventies that cells 
can reduce the sensing error by increasing the number 
of measurements, and that they can do so in two prin¬ 
cipal ways [3]. The first is to simply increase the num¬ 
ber of receptors. The other is to increase the number of 
measurements per receptor. In the latter scenario, the 
cell infers the ligand concentration not from the instan¬ 
taneous ligand-binding state of the receptor, but rather 


from its average over some integration time T. This time 
integration has to be performed by the signaling network 
downstream of the receptor proteins. 

In recent years, tremendous progress has been made in 
understanding how accurately cells can measure chem¬ 
ical concentrations n [51 mm- Most of these studies 
assume that the cell estimates the concentration via the 
mechanism of time integration as envisioned by Berg and 
Purcell O El EHUl ESI [T5H2T] . although Mora, Endres, 
Wingreen and others have shown that under certain con¬ 
ditions a better estimate of the concentration can be ob¬ 
tained via maximum likelihood estimation [HIIlEg. In 
this review, we will limit ourselves to sensing static con¬ 
centrations, which do not change on the timescale of the 
response, and we will focus on the mechanism of time in¬ 
tegration, although we will also briefly discuss the scheme 
of maximum likelihood estimation. This review will fol¬ 
low a series of papers written by the authors, but, in 
doing so, will also discuss other relevant papers. 

Specifically, in this review we will address the follow¬ 
ing questions: if the downstream signaling network inte¬ 
grates the state of the receptor over some given integra¬ 
tion time T, what is then the sensing error? This is the 
question that was first addressed by Berg and Purcell |5] , 
and later followed up by many authors |5l|9HIIlll3llI3- 
Eni. The answer depends on the correlation time of the 
receptor, which is determined by the stochastic arrival 
of the ligand molecules at the receptor by diffusion and 
on the stochastic binding of the ligand molecules to the 
receptor. Recently, the correct expression for the corre- 
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lation time and hence the sensing error has become the 
subject of debate [a El [IS], which we will review in sec¬ 
tion]^ The next question is: How do signaling networks 
integrate the receptor state? Do they integrate it uni¬ 
formly in time, as assumed by Berg and Purcell? If not, 
can cellular sensing systems then actually reach the sens¬ 
ing limit of Berg and Purcell? As we will see, signaling 
networks can not only reach the Berg-Purcell limit, but, 
in some cases, even beat it by 12% m- 

Importantly, the signaling network downstream of the 
receptor is stochastic in nature, which means that while 
the network is removing the extrinsic noise in the re¬ 
ceptor signal, it will also add its own intrinsic noise to 
the transmitted signal. Most studies have ignored this 
intrinsic noise in the signaling network, essentially as¬ 
suming that it can be made arbitrarily small [aigii- 
mnSl (HHIl EHM]. However, can signaling networks 
remove the extrinsic noise in the input signal and simulta¬ 
neously suppress the intrinsic noise of the signaling net¬ 
work HOI lU? If so, what resources—receptors, time, 
readout molecules, energy—are required? Do these re¬ 
sources fundamentally limit sensing, like weak links in a 
chain? Or can they compensate each other, leading to 
trade-offs between them? We will see that equilibrium 
networks, which are not driven out of thermodynamic 
equilibrium, can sense—energy dissipation is not essen¬ 
tial for sensing [21) . However, their sensing accuracy is 
limited by the number of receptors; adding a downstream 
network can never improve the precision of sensing. This 
is because equilibrium sensing systems face a fundamen¬ 
tal trade-off between the removal of extrinsic and intrin¬ 
sic noise m- Only non-equilibrium systems can lift this 
trade-off: they can integrate the receptor state over time 
while suppressing the intrinsic noise by using energy to 
store the receptor state into stable chemical modification 
states of the readout molecules muni mi- Storing the 
state of the bound receptor over time using a canonical 
push-pull signaling network requires at least one readout 
molecule to store the state and at least dfcsT of energy 
to store it reliably m- Non-equilibrium systems thus 
require three resource classes that are fundamentally re¬ 
quired for sensing—receptors and their integration time, 
readout molecules, and energy. Each resource class sets a 
fundamental sensing limit, which means that the sensing 
precision is bounded by the limiting resource class and 
cannot be enhanced by increasing another class. 

Last but not least, we will address the question of 
whether cellular sensing involves computations that can 
be understood using ideas from the thermodynamics of 
computation |50|. Cells seem to copy the ligand¬ 
binding state of the receptor into chemical modifica¬ 
tion states of downstream readout molecules OEniEll, 
but can this process be rigorously mapped onto compu¬ 
tational protocols typically considered in the computa¬ 
tional literature [27|? If so, how do these cellular copy 
protocols compare to thermodynamically optimal proto¬ 
cols? Can they reach the Landauer bound, which states 
that the fundamental limit on the energetic cost of an 


irreversible computation is fcBTln(2) per bit? We will 
see that cellular copy operations differ fundamentally in 
their design from thermodynamically optimal protocols, 
and that as a result they can never reach the Landauer 
limit, regardless of parameters m- 


II. THE BERG-PURCELL LIMIT 


A. Set up of the problem 


Berg and Purcell and subsequent authors [3 0 El- 
uniiaiiTHisi [Mj considered the scenario in which the 
cell estimates the ligand concentration c, assumed to be 
constant on the timescale of the response, by monitor¬ 
ing the occupancy of the receptor to which the ligand 
molecules bind and unbind. The key idea is that the 
cell infers the concentration by estimating the true av¬ 
erage receptor occupancy n from the average occupancy 
riT over some integration time T, and by inverting the 
input-output relation fi(c) [3|- A central result is that for 
a single receptor. The time average of its occupancy n{t) 
over the integration time T is tit = (1/T) n{t')dt'. 
Using error propagation, the fractional error in the esti¬ 
mate of the concentration, 5c/c, is then given by 



where is the variance in the time-averaged occupancy 
rixi and dn/dc is the gain, which determines how the er¬ 
ror in the estimate of n propagates to that in the estimate 
of c. The gain can be obtained from the input-output re¬ 
lation n(c) = c/ (c+Kd), where Ku is the receptor-ligand 
binding affinity: dn/dc = n(l — n)/c. In the limit that 
the integration time T is much longer than the receptor 
correlation time Tc, the variance in the estimate ut of 
the true mean occupancy n is 


2 _ 2cr^re 
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Cn (s = 0) 
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( 2 ) 


where the instantaneous variance cr^ = (n^) — (n)^ = 
n{l—n) = p(l—p), withp = n the probability that the re¬ 
ceptor is ligand bound, and Pn(oj) and C„(s) are respec¬ 
tively the power spectrum and the Laplace transform of 
the correlation function Cn{t) of n{t). The above expres¬ 
sion shows that the variance in the average nx is given by 
the instantaneous variance divided by T/[2tc), which 
can be interpreted as the number of independent mea¬ 
surements of n[t). Inserting Eq. into Eq. yields 


^ 2tc 

Vcy p(l-p)T' 


(3) 


This is indeed the sensing error based on T/{2tc) inde¬ 
pendent concentration measurements. 
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Eq.|^ holds for any single receptor, be it a promoter on 
the DNA, a receptor on the cell membrane, or a receptor 
protein freely diffusing inside the cytoplasm [^. All we 
need to do to get the sensing error, is to find the receptor 
correlation time Tc, which depends on the scenario by 
which the ligand finds the receptor. 

B. Expression of Berg and Purcell 

To obtain the receptor correlation time Tc, Berg and 
Purcell assumed that the ligand binds the receptor in a 
Markovian fashion, which means that Tc is given by 

<“> 

where kf is the ligand-receptor binding rate and kb is the 
unbinding rate. Berg and Purcell described the binding 
site as a circular patch on the membrane, with patch ra¬ 
dius s. To get the forward rate kf, they assumed kf is 
given by the diffusion-limited binding rate k^, but with 
the cross section s renormalized by the sticking proba¬ 
bility. For the binding of a ligand to a membrane patch, 
kf = kjj = ADs. We will consider the binding of lig¬ 
and to a spherical receptor protein with ligand-receptor 
cross section a, in which case kf = ko = AiraD. To 
get the backward rate kb, Berg and Purcell exploited the 
detailed-balance condition kfc{l—p) = pkb, which states 
that in steady state the net rate of binding equals the net 
rate of unbinding. 

Combining Eqs.|^ and [^yields the following expression 
of Berg and Purcell for the sensing error 


before the first has diffused into the bulk. If this happens, 
then the receptor and the dissociated ligand molecule at 
contact are no longer surrounded by a uniform equilib¬ 
rium distribution of ligand molecules. Indeed, the process 
of binding generates non-trivial spatio-temporal correla¬ 
tions between the positions of the ligand molecules, which 
depend on the history of the association and dissociation 
events. This turns an association-dissociation reaction 
into a complicated non-Markovian, many-body problem, 
which can, in general, not be solved analytically. 

The second problem of the analysis of Berg and Purcell 
is that not all ligand-receptor association reactions are 
diffusion limited. Berg and Purcell were fully aware of 
this, but they argued on p. 208 of Ref. [3] that if the 
ligand “doesn’t stick on its first contact, it may very soon 
bump into the site again—and again. If these encounters 
occur with a time interval short compared to Tb [the time 
a ligand is bound], their result is equivalent merely to a 
larger value of a [the sticking probability]. As we have 
no independent definition of the patch radius s, we may 
as well absorb the effective a into s.” This argument, 
however, does not take into account that when a ligand 
arrives at the receptor for the first time and does not stick 
immediately, it may also return to the bulk, after which 
another ligand molecule may bind. Moreover, a ligand 
molecule that has just dissociated from the receptor may 
either rapidly rebind the receptor, or diffuse away from 
it into the bulk. It thus remained unclear how accurate 
the expression of Berg and Purcell, Eq. is. 

C. Expression of Bialek and Setayeshgar 


gp ATTaDc{l — p)T 

This expression can be understood intuitively: The factor 
AiraDc is the rate at which ligand molecules arrive at the 
receptor, 1 — p is the probability that the receptor is free, 
and hence 47rcrl?c(l — p) is the count rate at which the 
receptor binds the ligand molecules; AiraDc^l — p) mul¬ 
tiplied with T is thus the total number of counts in the 
integration time T. Indeed, this expression states that 
the fractional error 5c/c decreases with the square root 
of the number of counts, as we would expect intuitively. 

While this expression makes sense intuitively, there 
are two problems. First, receptor-ligand binding is, in 
general, not Markovian. To illustrate this, imagine for 
the sake of the argument that a ligand-bound receptor 
is surrounded by a uniform, equilibrium distribution of 
ligand molecules. If the receptor-bound ligand dissoci¬ 
ates, then the other ligand molecules will still have the 
equilibrium distribution. If it rebinds and then dissoci¬ 
ates again, the other ligand molecules will again still have 
the equilibrium distribution. The problem arises when a) 
the rebinding of the dissociated ligand molecule is pre¬ 
empted by the binding of another ligand molecule; and 
b) if this second molecule dissociates from the receptor 



Bialek and Setayesghar sought to generalize the result 
of Berg and Purcell by explicitly taking into account the 
receptor-ligand binding dynamics [S]. They considered a 
model in which the ligand molecules can diffuse, bind the 
receptor upon contact with an intrinsic association rate 
ka, and unbind from the receptor with an intrinsic disso¬ 
ciation rate kd- This model is described by the following 
reaction-diffusion equations 


dn{t) 

dt 

dc{x, t) 


dt 


kaC{xo, t){l - n{f)) - kdn{f) 
DV‘^c{x,t) - 5(x - 


( 6 ) 

(7) 


where c(x, t) is the concentration of ligand at position 
X at time t and xq is the position of the receptor. To 
solve these equations, Bialek and Setayesghar invoked the 
fluctuation-dissipation relation, leading to a linearization 
of Eqs. [^and[^ 

The resulting expression for the sensing error is 


_ 1 2 
c ) Bs TraDcT k^c (1 — p)T 


( 8 ) 


The first term describes the contribution to the sens¬ 
ing error from the stochastic transport of the ligand 
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molecules to the receptor by diffusion. The second term 
describes the contribution from the intrinsic stochasticity 
of the binding kinetics of the receptor: Even in the limit 
that D —>■ oo, such that the ligand concentration is uni¬ 
form in space at all times, the ligand concentration can 
still not be measured with infinite precision because the 
receptor stochastically switches between the bound and 
unbound states, leading to noise in the estimate of the 
receptor occupancy. This term is absent in Eq. since 
Berg and Purcell assume that the binding reaction is fully 
diffusion limited, meaning that the intrinsic rates ka and 
kd go to infinity. Indeed, for fast, diffusion-limited reac¬ 
tions, this term can be much smaller than the first one. 
The rate ka is the rate of ligand-receptor binding, given 
that receptor and ligand are in contact. Its maximum 
rate is given by transition-state theory, which yields the 
rate Ictst in the absence of any recrossings of the dividing 
surface that separates the bound from the unbound state 
[221 [30] • It is given by fcxsT = exp[—,5AF], where AF 
is the free-energy barrier separating the bound form the 
unbound state, and ko is a kinetic prefactor. For spheri¬ 
cal molecules that can bind in any orientation, it is given 
by ko = TTcr^ {\vrl\), where vrl is the relative velocity 
of ligand and receptor. For diffusion-limited reactions, 
AF = 0, and k^^^ = fcg = ttct^ (|i’i?L|), which is typically 
much larger than the diffusion-limited rate kj) = AiraD. 

More generally, the first term on the right-hand side 
Eq.i presents a noise floor that is solely due to the 
stochastic transport of the ligand to the receptor by dif¬ 
fusion, independent of the binding kinetics of the ligand 
after it has arrived at the receptor. The first term is 
thus considered to be the fundamenetal sensing limit set 
by the physics of diffusion [S], and it can be compared 
with the expression of Berg and Purcell, Eq. It is 
clear that the expression of Bialek and Setayesghar and 
that of Berg and Purcell differ by a factor 1/(2(1 — p)). 
This difference can have marked implications. Although 
the Bialek-Setayeshgar expression predicts that the un¬ 
certainty due to diffusion remains bounded even in the 
limit that p —)■ 1, the Berg-Purcell expression suggests 
that it diverges in this limit. Intuitively, we expect a de¬ 
pendence on p, because a higher receptor occupancy at 
fixed ko should reduce the count rate. 


D. The expression of Kaizu and coworkers 


To elucidate the discrepancy between Eqs. and 
Kaizu and coworkers rederived the expression for the 
sensing error m- They considered exactly the same 
model as that of Bialek and Setayesghar [9] , but analyzed 
it using the large body of work on reaction-diffusion sys¬ 
tems, developed by Agmon, Szabo and coworkers m- 
The goal is to obtain the zero-frequency limit of the cor¬ 
relation function, C{s = 0), from which the correlation 
time and hence the sensing error can be obtained, see 
Eq.0 The correlation function of any binary switching 


process is given by 

Cn (t) = p° (p*|* (r) - p°) (9) 

where p^ = nis the equilibrium probability for the bound 
state (*) and p*|*(t) = {n{T)n{Q))/n is the probability 
the receptor is bound at t = r given it was bound at 
t = 0. To obtain the correlation function, we thus need 
P*\*{t) = 1 — ci^rev (t|*), where (t|*) is the probabil¬ 
ity that the receptor is free at time t given that it was 
occupied at time t = 0. It is given by the exact expression 

^rev (t|*) =kd [ [1 - y^ev (t'|*)] (t “ t'\a) dt'. 

Jo 

( 10 ) 

The subscript “rev” denotes that a reversible reaction 
is considered, meaning that in between t = 0 and t the 
receptor may bind and unbind ligand a number of times. 
The probability that a receptor-ligand pair dissociates 
between and t'+df to form an unbound pair at contact 
is kd[l — yrev{t'\*)]dt', while the probability that the free 
receptor with a ligand molecule at contact at time t' is 
still unbound at time t > t' is yrad{t — t'\a)-, the subscript 
“rad” means that we now consider an irreversible reaction 
{kd = 0), which can be obtained by solving the diffusion 
equation using a “radiation” boundary condition Ell- 
While Eq. [^is exact, it cannot be solved analytically, 
because, as discussed above, an association-dissociation 
reaction is a non-Markovian, many-body problem. To 
solve Eq. Kaizu and coworkers made the assump¬ 
tion that after each receptor-ligand dissociation event, 
the other ligand molecules have the uniform, equilibrium 
distribution. Mathematically, this assumption can be ex¬ 
pressed as 


yrad {t\cr) = y^ad (t|eq) ^rad {t\cr) , (H) 

where o5^rad(t|eq) is the probability that a receptor which 
initially is free and surrounded by an equilibrium dis¬ 
tribution of ligand molecules remains free until at least 
a later time t, while iS'rad(t|o') is the probability that a 
free receptor that is surrounded by only one single ligand 
molecule, which initially is at contact, is still unbound 
at a later time t. To solve Eqs. and [m a relation 
between y^ad (t|eq) and ^rad (tier) is needed, which can 
be obtained from o5^rad (t|eq) = ferad(t )dt 

the detailed-balance relation for the time-dependent bi- 
molecular rate constant fcrad(t) = kaSrad{t\cr) [3T] . 

With these relations, Eqs. and 0 can be solved, 
which, together with Eqs. and yields the following 
expression for the the sensing error m- 

2 2 

4:7TaDc{l — p)T kac{l — p)T ^ ^ 

The second term is identical to that of Bialek and Se¬ 
tayesghar, Eq. However, the first term, which consti¬ 
tutes the fundamental limit, disagrees with the expres¬ 
sion of Bialek and Setaeysghar, but agrees with that of 
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Berg and Purcell, Eq. This suggests that the expres¬ 
sion of Berg and Purcell is indeed the most accurate ex¬ 
pression for the fundamental sensing limit. 

But it could of course be that both the analysis of Berg 
and Purcell and that of Kaizu et al. are inaccurate. To 
investigate this, Kaizu and coworkers performed particle- 
based simulations of the same model studied by Bialek 
and Setayesghar and Kaizu et al.; to test the expression 
of Berg and Purcell, the system was chosen to be deep 
in the diffusion-limited regime. The simulations were 
performed using Green’s Function Reaction Dynamics, 
which is an exact algorithm to simulate reaction-diffusion 
systems at the particle level in time and space, and hence 
does not rely on the approximation used to derive the an¬ 
alytical result of Kaizu et al. [551 - 155] . Fig. shows the 
results for the zero-frequency limit of the power spec¬ 
trum, Pn{oj —>■ 0) = 2(7^Tc, which provides a test for the 
receptor correlation time Tc and hence the sensing error 
(see Eqs. and [^, because tr^ = n(l — n). It is seen 
that the prediction of Kaizu and coworkers agrees very 
well with the simulation results, in contrast to that of 
Bialek and Setagesghar. This shows that the expression 
of Kaizu et al. and hence that of Berg and Purcell, is the 
most accurate expression for the sensing precision. 



Fractional occupancy n 


FIG. 1: The zero-frequency limit of the power spectrum, 
P„{uJ —> 0) = 2(7^Tc with (T^ = n(l — n), as a function of 
the average receptor occupancy n for c = 0.4 ^M; n is var¬ 
ied by changing kd. It is seen thatthe theoretical prediction 
of Kaizu et al. [T^ (red line) agrees very well with the sim¬ 
ulation results (red symbols), in contrast to that of Bialek 
and Setayeshgar [5] (black line). Parameters: D = 1 /rm^ s“^, 
a — 10 nm, L = 1 /rm, ka = 552 /iM“'^s“^. 


E. Role of rebinding 


The question remains why the analysis of Kaizu et 


al. is so accurate. The central assumption of Eq. II 


makes the propensity for binding the next ligand inde¬ 
pendent of the history of the previous binding events. In 
essence, it reduces the non-Markovian many-body prob¬ 


lem to a Markovian two-body problem, which can be 
seen from the expression for the receptor correlation time 
Tc = {<Tl)~^Cn{s = 0): 


I 


(13) 


Here fcon and kos are the renormalized association and 
dissociation rates 


kriTn — I , 


I 


1 


ka ko 


, kd ku 


-1 


kako 

ka + ko' 

_ kdkp 

ka + kp' 


(14) 

(15) 


with K'eq = ka/kd = fcon/fcoff the equilibrium constant 
and kp = AiraD the diffusion-limited rate constant— 
kp = fcrad(t —f oo) for ka —f oo. Eq. 13 is the expression 


for the correlation time of a receptor that switches in 
a memoryless fashion between the bound and unbound 
states with switching rates fconC and feoff- 

But why is Eq. [D accurate? And what is the role of 
rebindings? Do they not generate an algebraic tail in 
the correlation function? As it turns out, these ques¬ 
tions are intimately related. It is well known that in an 
unbounded system, the correlation function exhibits an 
algebraic tail because at long times the relaxation of the 
receptor state is dominated by the slow diffusive trans¬ 
port of the ligand over long distances [361 El]. However, 
we typically expect the space to be bounded, both for 
the binding of ligand to a receptor inside the cell and to 
a receptor at the cell surface. Indeed, the simulations 
of [19j were performed in a finite box of cellular dimen¬ 
sions, yielding exponential, not algebraic, decay at long 
times. We then expect Eq. |TT]t o become accurate. More 
specifically, assumption Eq. jllj breaks down when a) the 
rebinding of a dissociated particle is pre-empted by the 
binding of another particle from the bulk; and b) if this 
second particle dissociates from the receptor before the 
first has equilibrated by diffusing into the bulk. However, 
the time a ligand molecule spends near the receptor is 
typically much shorter than the time for molecules to ar¬ 
rive from the bulk at biologically relevant concentrations, 
which means that the probability of rebinding interfer¬ 
ence is very small, and condition a) is not met. Because 
biologically relevant concentrations are low, also the dis¬ 
sociation rates are typically low, which means that also 
condition b) is not met. The likelihood that both condi¬ 
tions are met, necessary for the analysis to break down, 
is thus very small m- 

Because rebindings are so much faster than bulk ar¬ 
rivals, they can be integrated out [HI [381159| . The prob¬ 
ability that a particle that has just dissociated from the 
receptor will rebind the receptor rather than diffuse away 
into the bulk is Preb = 1 - 5'rad(oo|cr) = ka/{ka + kp). 
The mean number of rounds of rebinding and dissoci¬ 
ation before the molecules diffuse into the bulk is then 
A^reb = ka/kp, which rescales the effective dissociation 
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rate: kos = kd/{N^eh + 1) = kdko/ika + ko)- Simi¬ 
larly, a molecule that arrives at the receptor from the 
bulk may either bind the receptor or escape back into 
the bulk with probability Pesc = 1 — Preb; the mean 
number of rounds of escape and arrival before binding 
is iVesc = 1/-/Vreb, which rescales the effective association 
rate k^r, = ko/iX + N^^c) = kako/iK + ko)- These are 
indeed precisely the rates of Eqs. [T4]and[T5| 


This analysis also elucidates the role of rebinding in 
sensing. The probability of rebinding does not depend 
on the concentration, and rebindings therefore do not 
provide information on the concentration. They merely 
increase the receptor correlation time by increasing the 
effective receptor on-time from k'X^ to k^g = k^^/il + 
N^eh)- After (l-fA^reb) rounds of dissociation and rebind¬ 
ing, the molecule escapes into the bulk, and then another 
molecule will arrive at the receptor with rate kjjc; this 
molecule may return to the bulk or bind the receptor, 
such that a new molecule will bind after a time (fconc)”^ 
on average. Importantly, this molecule will bind in a 
memoryless fashion and with a rate that depends on the 
concentration. This binding event thus provides an inde¬ 
pendent concentration measurement. The mean waiting 
time in between independent binding events is therefore 


Tw = 1/fcoff + l/(fconc), which allows us to rewrite Eq. 12 
in a form that we would expect intuitively: 


Jcy _ 2 _ 2r^ 

C ) KZ konc{l -p)T T 


(16) 


Indeed, the sensing error Sc/c decreases with the square 
root of the number of independent measurements T/t^, 
during the integration time T. 

Lastly, why does the expression of Bialek and Se- 
tayesghar, Eq. miss the factor 1 — p in the diffu¬ 
sion term? We believe that this is because by invok¬ 
ing the fluctuation-dissipation theorem, Bialek and Se- 
tayesghar effectively linearize the reaction-diffusion prob¬ 
lem, thereby ignoring correlations between the state of 
the receptor and the local ligand concentration. This 
idea is supported by the analysis of Berezhkovskii and 
Szabo |24j . who recently derived an expression for the 
accuracy of sensing via multiple receptors on a sphere, 
ignoring spatio-temporal correlations between the states 
of the respective receptor molecules and the ligand con¬ 
centration. Interestingly, in the limit that the number 
of receptors on the sphere goes to infinity, then, by re¬ 
placing the radius of the cell with the cross section of 
the receptor, their expression becomes identical to that 
of Bialek and Setayesghar, see also Eq. below; indeed, 
this expression does not contain the factor (1 — p). This 
can be understood by noting that in the limit that the 
number of receptors becomes large, there will always be 
receptor molecules available for binding the ligand. But 
for a single receptor, we have to take the binary character 
of the receptor state into account. 


III. CAN CELLS REACH THE BERG-PURCELL 
LIMIT? 


The work of Berg and Purcell and subsequent studies 
like those discussed above assume 

not only a given integration time T, but also that the 
downstream signaling network averages the state of the 
receptor uniformly in time over this integration time T. 
It remained unclear, however, how the signaling network 
determines the (effective) integration time T, whether the 
network averages the signal uniformly in time, and how 
this assumption affects the sensing precision m- It thus 
remained open whether signaling networks can actually 
reach the Berg-Purcell limit. 

To address these questions, the authors of Ref. m 
considered linear, but otherwise arbitrary signaling net¬ 
work. For deterministic networks of this type, the output 
X{To) at time To can be written as 

Xit) = ( “ x{To - t')RL{t')dt\ (17) 

J —oo 


where xif ~ t') is the response function of the network 
and RL{t) is the stochastic receptor signal. To compare 
to previous results, the authors assumed that at t = 0 
the environment changes instantaneously and that the 
receptors and hence RL(t) immediately adjust, so that 
RL{t) is stationary for 0 < t < To, with fluctuations 
that decay exponentially with correlation time Tc m- 
Moreover, they assumed that either: (1) x{To — t) = 0 
for t < 0, which corresponds to a scenario where the 
response time Tr of the network is shorter than To, or, 
equivalently, the network reaches steady state by the time 
To', or (2) RL{t) = 0 for t < 0, which corresponds to a 
scenario in which the cell is initially in a basal state. In 
both cases, A(f) = x{To—t')RL{t')dt' . When neither 

x{To—t) nor RL{t) are zero for t <0, then previous states 
of the environment influence the state of the network at 
To, which can either be a source of noise, or a source of 
information if the environments are correlated. 

The idea is that the cell infers the ligand concentration 
from the output X{Tq) and by inverting the input-output 
relation X(c). Using error propagation, the error in the 
estimate of the concentration is then given by 


<5c\^ 1 f dc\^ 2 


(18) 


The authors of Ref. m then studied different signal¬ 
ing architectures, shown in Fig. Clearly, these net¬ 
works do not, in general, average the receptor signal uni¬ 
formly in time; instead, they have non-uniform weighting 
functions (Fig. IK ,C,E,G). They weigh receptor signals 
in the past with a response function that depends on 
both the lifetime of the signaling molecules and on the 
topology of the signaling network. One-layer networks 
consisting of a single reversible reaction give most weight 
to the most recent signal value (left-most column), while 
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FIG. 2: Extracting information from noisy input signals with linear signaling networks. (A,C,E,G) The weighting functions 
corresponding to different signaling networks are not uniform. (B,D,F,H) The ability of a signaling network to measure ligand 
concentration depends on its weighting function. The typical error (variance) in the estimate of ligand concentration is plotted 
as a percentage increase over the error of an estimate based on uniform weighting, assumed in the Berg-Purcell limit (Eq. 1 
with T = To). (A) Reversible, one-level cascades selectively amplify late {t = To) values of the signal, (B) leading to worse 
performance than the uniform average. (G) Irreversible, A^-level cascades amplify early (t = 0) values of the signal, (D) leading 
to worse performance than the uniform average. (E) The optimal weighting function, given in Ref. [15], averages the signal, 
selectively amplifying less correlated values. The delta functions are truncated for illustration. (E) The optimal weighting 
function outperforms the uniform average. (G) A signaling network consisting of two branches, which selectively amplify late 
{t = To) (left branch) and early {t = 0) (right branch) values of the signal, approximates the optimal weighting function 
(fci = 3.1; fc 2 = 10; ^3 = 1; A :4 = 0.35; fes = 1; kg ^ 1; To = 2). (H) The network in (F) can outperform the uniform average 
(tc varies for fixed To = 2). 


multi-level cascades consisting of irreversible reactions 
give more weight to signal values more in the distant past 
(second column). This concept can be generalized to ar¬ 
bitrarily large signaling networks. Multilevel reversible 
cascades have weighting functions that peak at some fi¬ 
nite time in the past, balancing the down-weighting of 
the signal from the distant past due to the reverse re¬ 
actions, with the down-weighting of the signal from the 
recent past resulting from the multilevel character of the 
network. Linear combinations of the weighting functions 
for reversible and irreversible cascades can be achieved 
with multiple cascades that are activated by the input in 
parallel and which independently activate the same effec¬ 
tor molecule. Clearly, signaling networks allow for very 
diverse weighting functions. 

This idea can be exploited to improve the accuracy 
of sensing, as shown in the right two columns of Fig. 

A network with a feedforward topology that combines 
a fast reversible cascade with a slow irreversible cascade 
cannot only reach the Berg-Purcell limit, but even beat it 
by 12%, when the observation time To is on the order of 
the receptor correlation time Tc- The reason is that this 
network selectively amplifies the more recent signal val¬ 
ues and those further back in the past. This is beneficial, 
because these signal values are less correlated. 

While the data processing inequality suggests that it 
is advantageous to limit the number of nodes in a signal¬ 
ing network to minimize the effect of intrinsic noise, this 


study shows that there can be a competing effect in favor 
of increasing the number of nodes: better removal of ex¬ 
trinsic noise. Additional nodes make it possible to sculpt 
the weighting function for averaging the incoming signal, 
allowing signaling networks to reach and even exceed the 
Berg-Purcell limit. 


IV. FUNDAMENTAL SENSING LIMIT OF 
EQUILIBRIUM SYSTEMS 

Signaling networks are stochastic in nature, which 
means that while they may remove the extrinsic noise 
in the input signal, they will also add their own intrinsic 
noise to the transmitted signal. Most studies on the ac¬ 
curacy of sensing have ignored this intrinsic noise of the 
signaling network [3J 015HT51 [T^ [TTHTOl E5] . They es¬ 
sentially assume that the intrinsic noise can be made ar¬ 
bitrarily small and that the extrinsic noise in the receptor 
signal can be hltered with arbitrary precision by simply 
integrating the receptor signal for longer. However, the 
extrinsic and intrinsic noise are not generally indepen¬ 
dent m- This raises the question whether the extrinsic 
and intrinsic noise can be lowered simultaneously, and if 
so, what resources would be required to achieve this. 

To address these questions, the authors of [2T] first 
studied equilibrium networks that are not driven out of 
thermodynamic equilibrium via the turnover of fuel. In- 





































spired by one component signaling networks |41j . they 
started with the simplest possible equilibrium network, 
consisting of cytoplasmic readout molecules X that di- 

k{ 

rectly bind ligand-free receptors R: R-l-L ^ RL, R-l-X ^ 

kj- 

RX. The linearized deviation 5x{t) = X{t) — X of the 
copy number X{t) from its steady-state value X is 

Sx{t) = j xit- t') bRL{t') + Vit')], ( 19 ) 

J —oo 


where x(t —f') = is the response function with 

T/ = l/{kf{X + R) + kr) the integration time, 7 = k{X, 
RL(t) is the input signal and rj describes the intrinsic 
noise of the signaling network, set by the rate constants 
and copy numbers. 


The sensing error can be computed, as before, via 
Here, the variance cr^ = (i5x)^ can be decomposed 
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Eq._ 

into the sum of the extrinsic noise = x‘^Ksrl, 5 rl 

and the intrinsic noise = X^SRL,ri + where 

Ka,b = 

with the correlation function CAB{ti,t 2 ) = {A{ti)B{t 2 ))■ 
This decomposition is not unique, but in this form the 
extrinsic noise term features a canonical temporal aver¬ 
age of the input (receptor) fluctuations [JDJ [311133], which 
can be made arbitrarily small by increasing the effective 
integration time of the network. However, the authors 
of Ref. Ill] found that when doing so in a system with 
Rt receptors would reduce the total sensing error below 
A/Rt, the intrinsic noise would inevitably rise. The net¬ 
work faces a fundamental trade-off between the removal 
of extrinsic and intrinsic noise. 


Signaling networks are usually far more complicated 
than one consisting of a single readout species, and as 
discussed in the previous section, additional network lay¬ 
ers can reduce the sensing error m- This raises the 
question whether a more complicated equilibrium net¬ 
work can overcome the limit set by the number of re¬ 
ceptors. Searching over all possible network topologies 
to address this question is impossible. However, equilib¬ 
rium systems are fundamentally bounded by the laws of 
equilibrium thermodynamics, regardless of their topol¬ 
ogy. Indeed, starting from the grand-canonical partition 
function, one can show that for any equilibrium network 
the gain dX/dfi, with fj, = fj,° + /cTlog(c) the chemi¬ 
cal potential of the ligand, is given by the co-variance 
between X and RL, because RL (or, in general, 
the complex containing the ligand) is the species conju¬ 
gate to the chemical potential. This means that these 
systems face a trade-off between gain (sensitivity) and 
noise: increasing the gain inevitably increases the noise. 
This has marked implications: using dX/dyi = (Jxrr 
and Eq. [T^ we find that the sensing error based on the 
readout X is {6c/c)\ = rl)'^ ; while if the re¬ 

ceptors themselves are taken as the readout, the sensing 


error is ((5c/c)^^ = From this it follows that 


5c 


RL 




SR\ 

^ J RL 


> 1 ^ 
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RL 


Ry 


( 20 ) 

Here the first equality inequality on the right-hand side 
follows from the fact that |cr^ rl\I \/ ^ correla¬ 
tion coefficient, which is always less than 1 in magnitude. 
The second inequality follows from the observation that 
for any stochastic variable 0 < Y < a, (jy < a?/A, mean¬ 


ing that a 


2 

RL 


< Rr/A. Eq. 


20 


thus shows that in equilib¬ 


rium systems a downstream signaling network can never 
improve the accuracy of sensing. The sensing precision is 
limited by the total number of receptors Rr, regardless 
of how complicated the downstream network is, or how 
many protein copies are devoted to making it. 

What is the origin of the sensing limit in equilibrium 
sensing systems? These systems transduce the signal by 
harvesting the energy of ligand binding: this energy is 
used to boot off the downstream signaling molecules from 
the receptor. However, detailed balance, by putting a 
constraint on the binding affinities of receptor-readout 
and receptor-ligand binding, then dictates that receptor- 
readout binding also influences receptor-ligand binding, 
thus perturbing the future signal. Indeed, the trade-offs 
faced by equilibrium networks are all different manifes¬ 
tations of their time-reversibility. The only way for a 
time-reversible system to “integrate” the past is for it to 
integrate and hence perturb the future. Concomitantly, 
in a time reversible system, there is no sense of “up¬ 
stream” and “downstream”, concepts which rely on a 
direction of time [ 33 ]; RL is as much a readout of X, 
as the other way around. While in equilibrium systems 
the readout encodes the receptor state, the readout is 
not a stable memory that is decoupled from changes in 
the receptor state: a change in the state of the readout, 
induced by readout-receptor (un)binding, influences the 
future receptor state. This introduces cross-correlations 
between the intrinsic fluctuations in the activation of the 
readout, modeled by 77 (f) in Eq. 19 
fluctuations in the input RL{t): 
cross-correlations, which ultimately arise from time re¬ 
versibility, that lead, in these equilibrium systems, to a 
fundamental tradeoff between the removal of extrinsic 
and intrinsic noise and between increasing the gain and 
suppressing the noise. 


and the extrinsic 
KRL,'q ^ 0. It is these 


V. SENSING IN NON-EQUILIBRIUM SYSTEMS 


To beat the sensing limit of equilibrium systems, en¬ 
ergy and the receptor need to be employed differently. 
Rather than using the energy of ligand binding to change 
the state of the readout, the system should use fuel. This 
makes it possible change the readout via chemical mod¬ 
ification, with the receptor catalyzing the modification 
reaction: RL -|- X —>• RL -|- X*. This decouples receptor- 
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ligand binding from receptor-readout binding: the activa¬ 
tion of the readout does not influence the future receptor 
signal, while, conversely, a change in the receptor state 
does not affect the stability of the readout. Each readout 
molecule that has interacted with the receptor provides 
a stable memory; collectively, the readout molecules en¬ 
code the history of the receptor state. This enables the 
mechanism of time integration, in which the trade-off be¬ 
tween noise and sensitivity is broken, and the extrinsic 
and intrinsic noise can be reduced simultaneously |21] . 

Catalysts cannot change the chemical equilibrium of 
two reactions that are the microscopic reverse of each 
other. To make the average state of the readout depen¬ 
dent on the average receptor occupancy, the activation 
reaction RL -|- X —RL -|- X* must therefore be coupled 
to a reaction that is not its microscopic reverse, and the 
system must be driven out of equilibrium. This is pre¬ 
cisely the canonical signaling motif of a receptor driving 
a push-pull network. In such a network the receptor it¬ 
self or the enzyme associated with it, like CheA in E. coli 
chemotaxis, catalyzes the activation of a readout protein 
X via chemical modification, i.e. the phosphorylation of 
the messenger protein CheY; active readout molecules X* 
can then decay spontaneously or be deactivated by an en¬ 
zyme, like the phosphatase CheZ in E. coli^ via a reaction 
that is not the microscopic reverse of the activation reac¬ 
tion. Typically, the activation via chemical modification 
is coupled to fuel turnover, while deactivation is not; in 
E. coli chemotaxis, for example, phosphorylation of CheY 
is fueled by ATP hydrolysis: CheA -|- ATP -|- CheY —>• 
CheA -I- ADP -I- CheYp, while dephosphorylation is not: 
CheZ -I- CheYp —>■ CheZ + CheY -I- Pi. Another classical 
example is MAPK signaling, where activation of MAPK 
is driven by ATP hydrolysis, while deactivation is not 
(even though it is typically catalyzed by a phosphatase). 
In all these systems, ATP hydrolysis is used to drive the 
readout molecule to a high energy state, the active phos- 
phorylated state, which then relaxes back to the inactive 
dephosphorylated state via another pathway, setting up 
a cycle in state space leading to energy dissipation. 


A. The sensing error 

To derive the fundamental resources required for sens¬ 
ing, it is instructive to view the downstream system 
as a device that samples the state of the receptor dis¬ 
cretely [5D] . The activation reaction RL -I- X -|- ATP ^ 
RL -I- X* -I- ADP (assumed to be fueled by ATP hydroly¬ 
sis) generates samples of the ligand-binding state of the 
receptor by storing the receptor state in the stable mod¬ 
ification states of the readout molecules. We expect that 
if there are N receptor-readout interactions, then the cell 
has N samples of the receptor state and the error in the 
concentration estimate, 6c/c, is reduced by a factor of 
\/N. However, to derive the effective number of sam¬ 
ples, we have to consider not only the creation of sam¬ 
ples, but also their decay and reliability. The decay reac- 


k 

tion X* ^ X is equivalent to discarding or erasing sam¬ 
ples. The microscopically reverse reactions of these acti¬ 
vation and deactivation reactions, namely the receptor- 

mediated deactivation X* -|- RL -|- ADP X -|- RL -|- ATP 
and the spontaneous (or phosphatase catalyzed) activa- 

k— 

tion X X* independent of the receptor, generate in¬ 
correct samples of the receptor state. Energy is needed 
to break time-reversibility and to protect the coding. 

How the receptor samples are generated, erased, and 
how they are stored in the readout, determine the num¬ 
ber of samples, their independence, and their reliability, 
which together set the sensing precision ^0] : 

11 11 
p(l - p) TV/ (1 - p)2 TVeff ' 

In this expression, obtained using the here accurate 
linear-noise approximation [20l |40j, p is as before the 
probability that a receptor is bound to ligand. The quan¬ 
tity Nj, discussed below, is the average number of recep¬ 
tor samples that are independent out of a total of Aeff 
samples. The first term is the error on the concentra¬ 
tion estimate that would be expected on the basis of Nj 
perfect, independent samples of the receptor state that 
can be unambiguously identified (as in Eq. [^. A second 
correction term arises, however, because the cell cannot 
distinguish between those readout molecules that have 
collided with an unbounded receptor since their last de¬ 
phosphorylation event, and those that have not. 

The number of independent measurements TV/ can be 
expressed in terms of collective variables that describe 
the resource limitations of the cell 
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(1 -I- 2rc/A) — 1 p 
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( 22 ) 


This expression has a clear interpretation. The relaxation 
time Tr is the effective integration time. The quantity fi is 
the flux of X across the cycle of activation by the receptor 
and deactivation. The product nr^ is thus the number 
of cycles of read-out molecules involving collisions with 
ligand-bound receptor molecules during the integration 
time Tj.. The quantity fiTj./p is the total number of read¬ 
out cycles involving collisions with receptor molecules, be 
they ligand bound or not. It is thus the total number of 
receptor samples taken during Tr, N. 

Not all of these samples are reliable. The effective 
number of samples taken during Tr is iVeff = qN, where 
0 < g < 1 measures the quality of each sample. Here, 
A //1 and Ap 2 are the average free-energy drops across 
the activation and deactivation pathway respectively, in 
units of keT; Ap = Api + Afi 2 is the total free-energy 
drop across the cycle, which is given by the free energy of 
the fuel turnover, such as that of ATP hydrolysis. When 
Afi = Api = Ap2 = 0, an active read-out molecule is 
as likely to be created by the ligand-bound receptor as 










10 







FIG. 3: Trade-offs in non-equilibrium sensing. (A) When 
two resources A and B compensate each other, one resource 
can always be decreased without affecting the sensing error, 
by increasing the other resource; concomitantly, increasing a 
resource will always reduce the sensing error. When both re¬ 
sources are instead fundamental, the sensing error is bounded 
by the limiting resource and cannot be reduced by increas¬ 
ing the other. (B, C) The three classes time/receptor copies, 
copies of downstream molecules, and energy are all required 
for sensing, with no trade-offs among them. The minimum 
sensing error obtained by minimizing Eq.[^is plotted for dif¬ 
ferent combinations of (B) Xt and w, and (C) i?T(l + Tr/rc) 
and w. The curves track the bound for the limiting resource 
indicated by the grey lines, showing that the resources do not 
compensate each other. The plot for the minimum sensing er¬ 
ror as a function of i?T(l + TrjTc) and Xt is identical to that 
of (C) with w replaced by Xt- (D) The energy requirements 
for sensing. In the irreversible regime (A/r —>■ oo), the work to 
take one sample of a ligand-bound receptor, w/{pNf.ff), equals 
A/i, because each sample requires the turnover of one fuel 
molecule, consuming Ap of energy. In the quasi-equilibrium 
regime (A/r —>■ 0), each effective sample of the bound re¬ 
ceptor requires dksT, which defines the fundamental lower 
bound on the energy requirement for taking a sample. When 
Ajj, — 0, the network is in equilibrium and both w and N are 
0. ATP hydrolysis provides 20kBT, showing that phospho¬ 
rylation of read-out molecules makes it possible to store the 
receptor state reliably. The results are obtained fromEq. 
with Api — Afi 2 = Afij2. (E) Sampling more than once per 
correlation time requires more resources, while the benefit is 
marginal. As the sampling rate is increased by increasing the 
readout copy number Xt, the number of independent mea¬ 
surements Ni saturates at the Berg-Purcell limit RtTt/tc, 
but the energy and protein cost (oc Xt) continue to rise. 


it is created spontaneously and there is no coding and 
no sensing; indeed, in this limit, q = 0 and A^eff = 0. In 
contrast, when Apti, Ap 2 oo, <? —?> I and NeS N. 

The factor // denotes the fraction of samples that 
are independent. It depends on the correlation time 
Tc of receptor-ligand binding and on the time interval 
A = 2Tr/{Nf.Q/R t) between samples of the same recep¬ 
tor. Samples farther apart are more independent. 


B. Fundamental resources and trade-offs 


Eqs. and can be used to hnd the resources that 
fundamentally limit sensing. A fundamental resource or 
combination of resources is a (collective) variable that 
when fixed, puts a lower bound on the sensing error, no 
matter how the other variables are varied. It can be find 
via constraint-based optimization, yielding [20j : 


— 1 > MAX 


RtTt/i 


4 4 

Xt ’ WTr 


(23) 


This expression identihes three fundamental resource 
classes, each yielding a fundamental sensing limit: 
Rxil + Tr/Tc), which for the relevant regime of time inte¬ 
gration Tr > Tc is RtTc/tc, Xt, and WTr- These classes 
cannot compensate each other in achieving a desired sens¬ 
ing precision, and hence do not trade-off against each 
other. The sensing precision is, like the weakest link in a 
chain, bounded by the limiting resource, as illustrated in 
Fig.|^ -C. However, within each class, trade-offs are pos¬ 
sible. We now briefly discuss the fundamental resource 
classes and their associated sensing limits. 

Receptors and their integration time, The 

number of receptor samples increases with the number 
of readout molecules, Xt- In fact, as Xt —t oo, the 
spacing between the samples A —0 and the effective 
number of receptor samples Nf-e —t oo; this is indeed 
the Berg-Purcell mechanism of time integration. How¬ 
ever, each receptor can take an independent concentra¬ 
tion measurement only every 2tc, meaning that the num¬ 
ber of independent measurements taken during the inte¬ 
gration time Tr is, per receptor, TrjTc (the disappear¬ 
ance of the factor 2 is due to the fact that the deacti¬ 
vation of X increases the effective spacing between the 
samples, see [ 20 ] )■ Assuming that the receptors bind 
independently (but see section VIB), the total number 
of independent concentration measurements, Nj, taken 
during Tr, is then limited by RtTc/tc, no matter how 
large Xt is (Fig. |^). This yields the sensing limit of 
Berg and Purcell, (Sc/c)'^ > 4/(i?TTr/Tc), recognizing 
that the receptors are assumed to bind independently, 
and p{l — p) < 0.25 (c/. Eq. [^. While the product 
RrTrjTc is fundamental, Rt and are not: the error is 
determined by the total number of independent concen¬ 
tration measurements, and it does not matter whether 
these measurements are performed by many receptors 
over a short integration time or by one receptor over a 
long integration time. 
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The number of readout molecules, Xt- Each concen¬ 
tration measurement needs to be stored in the chemical 
modification state of a readout molecule, and lim¬ 
its the maximum number of measurements that can be 
stored. Consequently, no matter how many receptors the 
cell has, or how much time it uses to integrate the recep¬ 
tor state, the sensing error is fundamentally limited by 
the pool of readout molecules, (Sc/c)'^ > 

Energy, WTr, during the integration time. The power, 
the rate at which the fuel molecules do work, is zi; = hA/i, 
and the total work performed during the integration time 
is zc = WTr- This work is spent on taking samples of 
receptor molecules that are bound to ligand, because 
only they can modify X. The total number of effective 
samples of ligand-bound receptors obtained during r^, is 
pNes- Hence, the work needed to take one effective sam¬ 
ple of a ligand-bound receptor is w/{pNea) = A/z/q (see 
Eq. 22). Eig. shows this quantity as a function of 
A/i. In the limit that A/z ^ d/csT, w/(j)Nes) = A/z, 
because the quality factor <7 —>■ 1; in this regime, each 
receptor state is reliably encoded in the chemical modi¬ 
fication state of the readout, and increasing A/z further 
increases increases the sampling cost with no reward in 
accuracy. In the opposite regime, A/z < AksT, however, 
the quality of the samples, q, rapidly decreases with de¬ 
creasing A/z. In this regime, the system must take multi¬ 
ple noisy receptor samples to give the same information 
as one single perfect sample. In the limit A/z —>■ 0, the 
quality factor q —)■ A/z/4 and the work to take one ef¬ 
fective sample of a ligand-bound receptor approaches its 
minimal value of w/fpNgs) = A/z/g = AkT. Substitut¬ 
ing this in Eq. yields another bound on the sensing 
error: (dc/c)^ > A/(wTr). The bound can be reached 
when R^Tr/Tc and X^ are not limiting, and A/z —>■ 0. 
This bound shows that while the total work w = WTr 
done during the integration time Tr is fundamental, the 
power w and r^. are not, leading to a trade-off between 
accuracy, speed and power, as found in adaptation [ 3 ^. 


C. Design principle of optimal resource allocation 

The observation that resources cannot compensate 
each other, naturally yields the design principle of opti¬ 
mal resource allocation, which states that in an optimally 
designed system, each resource is equally limiting so that 
no resource is in excess and thus wasted. Quantitatively, 
Eq. predicts that in an optimally designed system 

RtTt/tc ^ Xt ^w. (24) 

In an optimal sensing system, the number of independent 
concentration measurements / Tc equals the number 

of readout molecules Xt that store these measurements 
and equals the work (in units of ksT) to create the sam¬ 
ples. Interestingly, the authors of Ref. [20] found that 
the chemotaxis system of E. coli obeys the principle of 
optimal resource allocation, Eq. This indicates that 


there is a selective pressure on the optimal allocation of 
resources in cellular sensing. 


VI. DISCUSSION 

A. Different sensing strategies encode and decode 
ligand information differently 

Cells use different sensing strategies, which differ in 
how they process information about the ligand concentra¬ 
tion. The data processing inequality |3S] guarantees for 
any network that no readout X can have more informa¬ 
tion about the ligand concentration encoded in its time 
trace than the ligand-bound receptor RE has in its time- 
trace m]: /(A[o,T](i);ML) < I{RL[o,T]{t);hL), where I 
is the mutual information between the arguments with 
Pl the chemical potential of the ligand, and z/[o,T](t) in¬ 
dicates the time trace oi y = X, RL from time 0 to time 
T. Clearly, the accuracy of sensing for any network is 
bounded by the amount of information that is in the 
time trace of the receptor state. However, the different 
sensing strategies differ in how they encode the ligand 
concentration in the receptor dynamics and in how they 
decode the information that is in the receptor time trace. 

For equilibrium networks, the data processing inequal¬ 
ity guarantees that no readout has more information 
about the ligand than the receptors at any given time 

m- /(^(T);/zl) < I{RL{T)-,piL) < log 2 (i?T + 1), and 

therefore the information in the instantaneous level of the 
readout is bounded by the total number of receptors Rt- 
This statement is the information-theoretic analogue of 
Eq. The history of receptor states does contain more 
information about the ligand concentration than the in¬ 
stantaneous receptor state, but an equilibrium signaling 
network cannot exploit this: its output contains no more 
information than the instantaneous receptor state. 

Cells that use the mechanism of time integration can 
exploit the information that is the time trace of the re¬ 
ceptor, and for these networks I{X{T); /z^) can be larger 
than I{RL{T); /z^). These cells estimate the ligand con¬ 
centration from the average receptor occupancy over an 
integration time, which, as we have seen in section m 
is determined by the architecture of the readout system 
and the lifetime of the readout molecules. It is quite clear 
that cells employ this mechanism of time integration: the 
central motif of cell signaling in both prokaryotes and 
eukaryotes, the push-pull network, implements time av¬ 
eraging by storing the receptor state into stable chemical 
modification states of the readout molecules, which, col¬ 
lectively, encode the average receptor occupancy over the 
past integration time. 

Another sensing strategy is maximum likelihood es¬ 
timation mm HI]. It estimates the ligand concen¬ 
tration not from the average receptor occupancy over 
the integration time T, as in the mechanism of time 
integration, but rather from the mean duration of the 
unbound state of the receptor r^: cmle = l/('riifcon)- 
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The sensing error of this strategy for a single recep¬ 
tor is (^c/c)^le = l/(^onc(l — p)T) [12], which is half 
that of the mechanism of time integration, see Eq. 

The reason why this sensing strategy is more accurate 
is that only the binding rate depends on the concentra¬ 
tion, not the unbinding rate. Hence, only the unbound 
interval provides information on the concentration. In 
contrast, the mechanism of time integration infers the 
concentration from the mean receptor occupancy, which 
depends on both the unbound interval and the uninfor¬ 
mative bound interval. 

How cells could actually implement the strategy of 
maximum-likelihood estimation remains an open ques¬ 
tion. One possibility is that receptors are internal¬ 
ized upon ligand binding, another that they bind ligand 
only briefly and signal only transiently, which could be 
achieved via receptor adaptation or desensitization fol¬ 
lowing ligand binding HH. Another intriguing possibil¬ 
ity has recently been suggested by Lang et al. [^. It 
is inspired by the observation that many receptors, such 
as receptor-tyrosine kinases and G-protein coupled re¬ 
ceptors, are chemically modified via fuel turnover | 22 j . 
In this scheme, the cell estimates the ligand concentra¬ 
tion from the average receptor occupancy over an inte¬ 
gration time T, as in the canonical mechanism of time 
integration. However, upon ligand binding, the receptor 
is driven via fuel turnover through a non-equilibrium cy¬ 
cle of m chemical modification steps, before it can release 
and bind new ligand again. In the limit that the energy 
drop over the cycle Ap, —>■ oo and m —>■ oo, the sensing 
accuracy approaches the maximum-likelihood-estimation 
limit, even though the concentration is inferred from the 
average receptor occupancy. The reason is that in this 
limit the interval distribution of the active receptor state 
becomes a delta function instead of an exponential one 
as in the case of canonical time integration. This elimi¬ 
nates the noise from the uninformative bound interval in 
estimating the average receptor occupancy. 


B. The importance of spatio-temporal correlations 


Ultimately, the precision of sensing via a mechanism 
that relies on integrating the receptor state, be it the 
canonical Berg-Purcell scheme with Markovian active re¬ 
ceptor states or the maximum-likelihood scheme of Lang 
et al. with non-Markovian active states |^, is deter¬ 
mined by the number of receptors, the receptor corre¬ 
lation time, and how the readout molecules sample the 
receptor molecules. The analysis of Ref. [20] ignores any 
spatio-temporal correlations of both the ligand molecules 
and the readout molecules. In this analysis, the differ¬ 
ent receptor molecules bind the ligand molecules inde¬ 
pendently, and the correlation time of the receptor clus¬ 
ter is that of a single receptor molecule Tc- The to¬ 
tal number of independent concentration measurements 
in the integration time T is then the number of re¬ 
ceptors Rt times the number of independent measure¬ 


ments per receptor, TjTc, yielding the fundamental limit 
(Sc/c) > 2tc/{p{1 — p)RtT). Importantly, because Tc 
is independent of the number of receptors, the sensing 
error decreases with the number of receptors. However, 
diffusion introduces spatio-temporal correlations between 
the different ligand-receptor binding events 1310(101 mi. 
Consequently, the correlation time r^v of Rt receptors on 
a spherical cell of radius TZ is not that of a single receptor 
molecule, but is rather given by [ 33 ] 

1 kaikaC + Rrkd) 

tn =,-1-•— --- 9 . (25) 

kaC + kd A-kDTZ (kaC + kd) 


As pointed out by Wang et al. HD], the correlation time 
Tjv increases with the number of receptors Rt (and even 
diverges for Rt —t 00 ), which means that when Rt is 
large and/or the integration time T is short, the mecha¬ 
nism of time integration breaks down. In this regime the 
equilibrium sensing strategy is superior, because it relies 
on sensing the instantaneous receptor state [10]. Using 
receptors that bind ligand non-cooperatively as the read¬ 
out, {5c/c)\j^ = I/ctIj^ = l/((p(l —p)Rt), which indeed 
decreases with Rt HOldl]. 

When the integration time T is longer than tn, the 
sensing error is given by [24] 

/^ _ 2tn 
V c y RtTpII - p) 

= -^- ( 1 + ^- 

RTkacT \ kd J 2 'kDTZcT 

(27) 

For large Rt (but not so large that tat > T), the sensing 
error reduces to 



1 


2t:DTZcT 


(28) 


This, apart from the factor 1 — p, is the classical result 
of Berg and Purcell [lio]. At sufficiently large i?r, the 
sensing error is limited by diffusion, the size of the cell 
and the integration time. It becomes independent of Rt, 
because the decrease of the instantaneous error with Rt, 
1/(Rt(p(1 — p)), is cancelled by the increase of the cor¬ 
relation time with Rt- 

Not only in the encoding of the ligand concentration 
in the receptor dynamics, but also in the decoding of this 
information by the readout system, spatio-temporal cor¬ 
relations can become important. Receptor and readout 
molecules are often spatially partitioned, due e.g.^ to the 
underlying cytoskeletal network or lipid rafts. Even in a 
system that is spatially homogeneous on average, spatio- 
temporal partitioning would occur, because of the finite 
speed of diffusion. We have recently shown that this par¬ 
titioning decreases the propagation of noise, essentially 
because the activation of the different readout molecules 
becomes less correlated [37]. Whether there exists an 
optimal diffusion constant of the readout molecules that 
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matches the correlation length and time of the receptors, 
which is set by the ligand diffusion and binding dynamics, 
is an intriguing question for future work. 


C. Cooperative receptor activation 

One important aspect that we have not addressed so 
far is the role of receptor cooperativity. It is now well es¬ 
tablished that receptors are often activated cooperatively, 
with the most studied and best characterized example be¬ 
ing the receptor cluster of the E. coli chemotaxis system. 
How does this affect the precision of sensing? This de¬ 
pends (again) on the receptor correlation time [H] . Skoge 
et al. found that while cooperative interactions between 
neighboring receptors can increase the gain, which re¬ 
duces the sensing error, they also increase the correla¬ 
tion time, such that independent receptors are, in fact, 
optimal. As we now know, equilibrium systems do not 
rely on time integration, and hence do not suffer from a 
slowing down of the receptor dynamics. In fact, we have 
shown that for all equilibrium systems in which the recep¬ 
tors bind the ligand non-cooperatively, {5c/c)\ > 1 /Rt\ 
hence, to reach the bound of Eq. for all equilibrium 
networks, cooperative ligand binding is necessary [la¬ 
in [21j we show that cooperative ligand binding makes it 
indeed possible to beat the non-cooperative bound, but 
whether equilibrium sensing systems can actually reach 
the bound of Eq. remains an open question. 


D. The role of energy in sensing 

It seems intuitively clear that fuel turnover can be used 
to enhance the precision of sensing, but how it can be 
used is less obvious. In the maximum-likelihood scheme 
of Lang et al. it is used to make the interval-distribution 
of the active receptor state more deterministic [12] • In 
the scheme of time integration, fuel turnover is used to 
sample the receptor state [T6| |20| . 

The latter example seems tantalisingly related to the 
thermodynamics of computation, formulated by Bennett 
and Landauer decades ago [23 [2S]- In particular, the 
receptor state appears to be copied into the chemical 
modification states of readout molecules, which thereby 
acts as memory elements for time integration [M Hoi- 
Performing copy operations repeatedly using the same 
readout requires net work input, unless the correlation 
between the data bit (receptor) and the memory (read¬ 
out), generated by the copy operation, is used to extract 
work m- Indeed, the arguments of Landauer and Ben¬ 
nett [251126j show that the minimal amount of work for a 
perfect copy cycle is ksT \n{2). But how does this bound 
apply to biochemical networks? 

To answer this question it is important to make a for¬ 
mal mapping between cellular sensing systems and copy 
operations. As it turns out, cellular copy protocols dif¬ 
fer fundamentally from ideal quasi-static protocols, such 


as those considered by Landauer and Bennett [23 HSj- 
Copying entails changing the state of the memory, which 
means that a thermodynamic driving force must be ap¬ 
plied to the system. Thermodynamically optimal pro¬ 
tocols increase the driving force slowly, such that the 
memory is slowly driven to its new state. In contrast, in 
cellular systems the thermodynamic driving force for the 
reactions that implement the copy process is typically 
constant, because the fuel molecules that drive these re¬ 
actions are commonly present at constant concentration 
m- As a result, cellular systems face a trade-off between 
cost and precision that is both qualitatively and quanti¬ 
tatively distinct from that required thermodynamically, 
regardless of parameters [22] ■ They dissipate more to 
achieve the same accuracy. One of the most vivid man¬ 
ifestations of this difference concerns the Landauer limit 
itself. One of the surprising, but by now well-known, re¬ 
sults of Bennett and Landauer was that quasi-static pro¬ 
tocols make it possible to perform repeated copies with 
100% accuracy at only a finite energy cost of, indeed, 
fcBTln(2) per copy. In contrast, cellular copy protocols 
can only reach 100% accuracy when the cost diverges. 
For the purpose of sampling a noisy signal, however, 
perfect copies are not necessarily ideal. Indeed, as we 
have seen in section VB[ the energetically most efficient 
approach to record the receptor state is to take many 
noisy samples, which together make up one effective sam¬ 
ple. For the canonical push-pull network considered here 
the minimal cost to take one effective receptor sample is 
2kBT on average if the receptor occupancy isp = 0.5 [23- 
For a bi-functional kinase system, in which the kinase as¬ 
sociated with the receptor catalyzes the phosphorylation 
of the readout when the receptor is bound to ligand, but 
dephosphorylation when the receptor is not bound to lig¬ 
and, this minimal cost is even lower: IksT [23- 


E. How resources determine the fundamental 
sensing limit: Trade-offs between equilibrium and 
non-equilibrium sensing 


Information processing devices require resources to be 
built and run. Components are needed to construct the 
system, space is required to accommodate the compo¬ 
nents and energy is required to make the components and 
operate the system. These resources constrain the design 
and performance of any device, and cellular sensing sys¬ 
tems are no exception. Making proteins is costly [48] . 
They also take up valuable space: both the membrane 
and the cytoplasm are highly crowded, with proteins oc¬ 
cupying 25-75% of the membrane area [H] and 20-30% of 
the cytoplasmic volume |50| . And many cellular signaling 
pathways, including two-component systems in bacteria 
m, GTP-ase cycles as in the Ras system [^, phos¬ 
phorylation cycles as in MAPK cascades [53], are driven 
out of thermal equilibrium via the turnover of fuel. Also 
the adaptation system that allows E. coli to adapt to a 
wide range of background concentrations is driven out of 
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FIG. 4: Cells face a fundamental trade-off between two 

modes of sensing, an equilibrium mode based on binding and 
sequestration and a non-equilibrium mode based on catalysis. 
These sensing strategies have different resource requirements. 


equilibrium |45] . However, cells also commonly employ 
equilibrium motifs, such as protein binding and seques¬ 
tration. Indeed, as we have seen, sensing does not funda¬ 
mentally require energy input |21j . Equilibrium sensing 
systems can respond to changes in the environment by 
harvesting the energy of ligand binding, thereby capital¬ 
izing on the work that is performed by the environment 
to change the ligand concentration. Also adaptation does 
not fundamentally require energy consumption |54j . 

When does the non-equilibrium sensing strategy out¬ 
perform the equilibrium one? This depends on the re¬ 
sources available to the cell, as summarized in Fig. 
Comparing the bound for non-equilibrium systems, 
Eq. |23[ with that for equilibrium ones without coop¬ 
erative binding, (i5c/c)^ > I/i?T, predicts that non¬ 
equilibrium systems can sense more accurately when 
there is at least one readout molecule available per re¬ 
ceptor, and the amount of energy dissipated per receptor 
during the integration time is at least IksT [21] . 

Interestingly, evolution may have toggled between 
equilibrium and non-equilibrium sensing strategies. Bac¬ 
teria employ both one- and two-component signaling net¬ 
works. One-component systems follow the equilibrium 
strategy, consisting of adaptor proteins which can bind 
an upstream ligand and a downstream effector. Two- 
component systems are similar to the non-equilibrium 
push-pull system considered here, consisting of a kinase 
(receptor) and its substrate. Intriguingly, some adaptor 
proteins, like RocR, contain the same-ligand binding do¬ 
main as the kinase and the same effector-binding domain 
as the substrate of a two-component system, i.e. NtrB- 
NtrC jTTj. They could thus transmit the same signal. 
Our results suggest that these are alternative signaling 


strategies, selected because of different resource selection 
pressures. It is tempting to believe that when sensing 
precision is important, but space for receptors on the 
membrane is limiting, non-equilibrium sensing becomes 
essential, because it makes it possible to take more con¬ 
centration measurements per receptor. 


VII. CONCLUSION 

In this review we have focused on sensing concentra¬ 
tions that do not vary on the timescale of the response 
of the system. While some questions remain open, such 
as the importance of spatio-temporal correlations in both 
ligand-receptor and receptor-readout binding, this prob¬ 
lem is by now fairly well understood. We understand how 
the receptor correlation time depends on the diffusion 
and binding kinetics of the ligand (although the question 
of the correlation time of multiple receptors is, arguably, 
still open), how the effective integration time depends on 
the lifetime of the readout molecules and the architec¬ 
ture of the readout network, and how the precision of 
sensing depends on the number of receptors, the number 
of readout molecules, the receptor correlation time, the 
integration time, and energy. We understand how com¬ 
binations of resources impose fundamental sensing limits 
and what this implies for the optimal design of cellular 
sensing systems. 

The challenge will be to make a similar leap for sys¬ 
tems that do not respond rapidly on the timescale of vari¬ 
ations in the input signal. For these systems, we have to 
take the dynamics of the input signal into account. On 
this front, progress has been made in recent years. We 
are now beginning to understand how in these systems 
information transmission depends on the lifetime of the 
readout molecules and on the topology of the readout 
network |55H55] , and what the trade-off between energy 
dissipation and information processing is Yet, 

many questions are still wide open: What is the perfor¬ 
mance measure that best descibres the design logic of 
cellular sensing systems? Is it the average sensing error, 
the instantaneous mutual information, the information 
transmission rate [55] , or the learning rate [mlEH? What 
resource combinations impose fundamental sensing lim¬ 
its? Also new questions arise: How accurately can living 
cells predict the future input signal [SS]? And what are 
the thermodynamic costs of cellular prediction [63l [64] ? 
The physics of sensing will remain a fascinating problem 
for many years to come. 
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